Archive TOULOUSE Archive Ouverte ( OATAO )
نویسندگان
چکیده
The OAEI Benchmark test set has been used for many years as a main reference to evaluate and compare ontology matching systems. However, this test set has barely varied since 2004 and has become a relatively easy task for matchers. In this paper, we present the design of a flexible test generator based on an extensible set of alterators which may be used programmatically for generating different test sets from different seed ontologies and different alteration modalities. It has been used for reproducing Benchmark bothwith the original seed ontology andwith other ontologies. This highlights the remarkable stability of results over different generations and the preservation of difficulty across seed ontologies, as well as a systematic bias towards the initial Benchmark test set and the inability of such tests to identify an overall winning matcher. These were exactly the properties for which Benchmark had been designed. Furthermore, the generator has been used for providing new test sets aiming at increasing the difficulty and discriminability of Benchmark. Although difficulty may be easily increased with the generator, attempts to increase discriminability provedunfruitful. However, efforts towards this goal raise questions about the very nature of discriminability.
منابع مشابه
Open Archive Toulouse Archive Ouverte (oatao) Interaction and Coalescence of Large Bubbles Rising in a Thin Gap
To cite this version: Huisman, Sander and Ern, Patricia and Roig, Véronique Interaction and coalescence of large bubbles rising in a thin gap. (2012) PHYSICAL REVIEW E, vol. 85 (n° 2). pp. 027302-1-027302-4. ISSN 1550-2376 Open Archive Toulouse Archive Ouverte (OATAO) OATAO is an open access repository that collects the work of Toulouse researchers and makes it freely available over the web whe...
متن کاملArchive TOULOUSE Archive Ouverte ( OATAO )
OATAO is an open access repository that collects the work of Toulouse researchers and makes it freely available over the web where possible. Lowering the applied potential during successive scratching/re-inoculation improves the performance of microbial anodes for microbial fuel cells.
متن کاملArchive TOULOUSE Archive Ouverte ( OATAO )
To cite this version : Souchier, Emeline and Besland, Marie-Paule and Tranchant, Julien and Corraze, Benoit and Moreau, Philippe and Retoux, Richard and Estournès, Claude and Mazoyer, Pascale and Cario, Laurent and Janod, Etienne Deposition by radio frequency magnetron sputtering of GaV4S8 thin films for resistive random access memory application. (2013) Thin Solid Films, vol. 533 . pp. 54-60. ...
متن کامل